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Abstract 

We conduct a brief survey on Wolfram's classification, in particular 
related to the computing capabilities of Cellular Automata (CA) in Wol- 
fram's classes III and IV. We formulate and shed light on the question 
of whether Class III systems are capable of Turing universality or may 
turn out to be "too hot" in practice to be controlled and programmed. 
We show that systems in Class III are indeed capable of computation and 
that there is no reason to believe that they are unable, in principle, to 
reach Turing-completness. 

Keywords: cellular automata, universality, unconventional computing, 
complexity, gliders, attractors, Mean field theory, information theory, 
compressibility. 

1 Wolfram's classification of Cellular Automata 

A comment in Wolfram's A New Kind of Science gestures toward the first dif- 
ficult problem we will tackle (ANKOS) (page 235): trying to predict detailed 
properties of a particular cellular automaton, it was often enough just to know 
what class the cellular automaton was in. The second problem we will take 
on concerns the possible relation between complexity of Cellular Automata and 
Turing universal computation, also highlighted by Wolfram in his ANKOS (page 
691- on Class 4 behaviour and Universality): / strongly suspect that it is true in 



general that any cellular automaton which shows overall class 4 behaviour will 
turn out — like Rule 110 — to be universal. The classification and identification 
of cellular automata (CA) has become a central focus of research in the field. In 
|108j , Stephen Wolfram presented his now well-known classes. Wolfram's analy- 
sis included a thorough study of one-dimensional (ID) CA, order (k = 2, r = 2) 
(where k £ Z + is the cardinality of the finite alphabet and r € Z + the num- 
ber of neighbours) , and also found the same classes of behaviour in other CA 
rule spaces. This allowed Wolfram to generalise his classification to all sorts of 
systems in |114j . 

An Elementary Cellular Automaton (ECA) is a finite automaton defined in 
a ID array. The automaton assumes two states, and updates its state in discrete 
time according to its own state and the state of its two closest neighbours, all 
cells updating their states synchronously. 

Wolfram's classes can be characterised as follows: 

• Class I. CA evolving to a homogeneous state 

• Class II. CA evolving periodically 

• Class III. CA evolving chaotically 

• Class IV. Includes all previous cases, known as a class of complex rules 
Otherwise explained, in the case of a given CA,: 

• If the evolution is dominated by a unique state of its alphabet for any 
random initial condition, then it belongs to Class I. 

• If the evolution is dominated by blocks of cells which are periodically 
repeated for any random initial condition, then it belongs to Class II. 

• If for a long time and for any random initial condition, the evolution is 
dominated by sets of cells without any defined pattern, then it belongs to 
Class III. 

• If the evolution is dominated by non-trivial structures emerging and trav- 
elling along the evolution space where uniform, periodic, or chaotic regions 
can coexist with these structures, then it belongs to Class IV. This class 
is frequently tagged: complex behaviour, complexity dynamics, or simply 
complex. 

Fig. [I] illustrates Wolfram's classes, focusing on a specific ECA evolution 
rule (following Wolfram's notation for ECA |107j ). All evolutions begin with 
the same random initial condition. Thus, Fig. [T^, displays ECA Rule 32 con- 
verging quickly to a homogeneous state, Class I. Figure [T]d displays blocks of 
cells in state one which evolve periodically showing a leftward shift, Class II. 
Figure [lj: displays a typical chaotic evolution, where no pattern can be recog- 
nised or any limit point identified, Class III. Finally, Fig. [TJi displays the so 
called complex class or Class IV. Here we see non-trivial patterns emerging in 
the evolution space. Such patterns possess a defined form and travel along the 
evolution space. They interact (collide), giving rise to interesting reactions such 
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Figure 1: Wolfram's classes represented by EC A rules: (a) Class I - EC A Rule 
32, (b) Class II - ECA Rule 10, (c) Class III - ECA Rule 126, (d) Class IV - 
EC A Rule 110. We have the same initial condition in all these cases, with a 
density of 50% for state (white dots) and state 1 (black dots). The evolution 
space begins with a ring of 358 cells for 344 generations. 
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as annihilations, fusions, solitons and reflections, or they produce new struc- 
tures. These patterns are referred to as gliders in the CA literature ('glider' is 
a widely accepted concept popularised by John Conway through his well-known 
additive binary 2D CA, the Game of Life (GoL) [31]). In Class IV CA we 
see regions with periodic evolutions and chaos, and most frequently in complex 
rules the background is dominated by stable states, such as in GoL. In such 
cases — and this is particularly true of the complex ECA Rule 110-the CA can 
evolve with a periodic background (called ether) where these gliders emerge and 
live. Gliders in GoL and other CAs such as the 2D Brian's Brain CA [99] caught 
the attention of Christopher Langton, spurring the development of the field of 
Artificial Life (AL) [53152]. 

Since the publication of the paper "Universality and complexity in cellular 
automata" in 1984 |108j . qualitative classifications of CA (an other systems) 
have been a much studied and disputed subject. Wolfram advanced several 
ECA rules as representatives for each of his classes and despite an early com- 
ment suggesting that (page 31): k — 2, r = 1 cellular automata are too simple to 
support universal computation, in his book "Cellular Automata and Complex- 
ity" |112) ECA Rule 110 was granted its own appendix (Table 15, Structures 
in Rule 110, pages 575-577). It contains specimens of evolutions, including a 
list of thirteen gliders compiled by Doug Lind, and also presents the conjecture 
that the rule could be universal. Wolfram writes: One may speculate that the 
behaviour of Rule 110 is sophisticated enough to support universal computation. 

An interesting paper written by Karel Culik II and Sheng Yu titled "Un- 
decidability of CA Classification Schemes" (26] [94] discussed the properties of 
such classes, concluding that: it is undecidable to which class a given cellular 
automaton belongs (page 177). Indeed, in 1984 Wolfram [108] commented (page 
1): The fourth class is probably capable of universal computation, so that prop- 
erties of its infinite time behaviour are undecidable. Actually, we can see that no 
effective algorithm exists that is capable of deciding whether a CA is complex 
or universal, and so far only a few discovered (as opposed to constructed) cellu- 
lar automata have been proven to be capable of universal computation (notably 
Wolfram's Rule 110 and Conway's Game of Life). However some techniques offer 
suitable approximations for finding certain sets of complex, though perhaps not 
necessarily universal rules (under Wolfram's PCE they would be, c.f. Section 
Q. In [101) . Israeli and Goldenfeld devised a coarse-grained technique to find 
predictable properties of elementary CA and other systems. While they were 
able to reduce elementary CAs in all Wolfram's classes, they were unable to do 
so for some in Class III (rules 30, 45, 106 and their symmetries) and more sur- 
prisingly in Class II (rule 154 and its symmetries). Their technique showed to be 
able to find properties of CA at some coarse-grained level of description without 
accounting for small-scale details. They show that by using this technique one 
can take a Class III system to a Class I in order to predict some properties of the 
original system by a reduction of its apparent complexity, pointing out that irre- 
ducibility may not be the same as complexity (or universality) given that some 
irreducible rules can be coarse-grained (at least one example of an irreducible 
rule (110) is known for certain because its ability of Turing universality). This 
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seems in agreement with the fact that systems in Class IV seem to show more 
persistent structures than systems in Class III. In "Local structure theory for 
cellular automata" [AO'. Howard Gutowitz developed a statistical analysis. An 
interesting schematic diagram conceptualising the umbral of classes of CA was 
offered by Wentian Li and Norman Packard in "The Structure of the Elemen- 
tary Cellular Automata Rule Space" [53] . Pattern recognition and classification 
has been examined in "Toward the classification of the patterns generated by 
one-dimensional cellular automata" |13j by Yoji Aizawa and Ikuko Nishikawa. 
An extended analysis by Andrew Adamatzky under the heading "Identification 
of Cellular Automata" in [5] considered the problem of how, given a sequence 
of configurations of an unknown cellular automaton, one may reconstruct its 
evolution rules. A recent special issue dedicated to this problem focuses on 
some theoretical and practical resultsj]] Klaus Sutner has discussed this clas- 
sification and also the principle of computational equivalence in "Classification 
of Cellular Automata" [55] , with an emphasis on Class IV or computable CA. 
An interesting approach involving an additive 2D CA was described in David 
Eppstein's classification scheme 

We will discuss some practical and theoretical topics that distinguish such 
classes and explore the computing properties of CA rules, in particular in classes 
III and IV. Among the topics we want to explore is the feasibility of using ex- 
tended analog computers (EAC) [75] for CA construction, in order to obtain 
unconventional computing models [U [3] . In this classification, Class IV is of 
particular interest because the rules of the class present non-trivial behaviour, 
with a rich diversity of patterns emerging, and non-trivial interactions between 
gliders, plus mobile localizations, particles, or fragments of waves. This fea- 
ture was useful in implementing a register machine in GoL |17j to determine 
its universality. First we survey some of the approximations that allow the 
identification of complex properties of CA and other systems. 

1.1 Mean field approximation 

The Mean field theory is a well-known technique for discovering the statistical 
properties of CA without analysing the evolution space of individual rules. It 
has been used extensively by Gutowitz in [42| . The method assumes that states 
in E are independent and do not correlate with each other in the local function 
ip. Thus we can study probabilities of states in a neighbourhood in terms of the 
probability of a single state (the state in which the neighbourhood evolves), and 
the probability of a neighbourhood would be the product of the probabilities of 
each cell in it. 

Harold V. Mcintosh in [57] presents an explanation of Wolfram's classes 

1 Special issue "Identification of Cellular Automata", Journal of Cellular Automata 2(1), 
1-102, 2007. http : //www. oldcltypublishing . com/ JCA/JCAcontents/ JCAv2nlcontents .html 
2 For a discussion see Tim Tyler's CA 1'AQ at http://cafaq.com/classify/index.php 

and more recently, a compression-based technique inspired by algorithmic information theory 
has been advanced 119 that offers a powerful method for identifying complex CA and other 
complex systems 
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using a mixture of probability theory and de Bruijn diagram^J resulting in a 
classification based on the mean field theory curve: 

• Class I: monotonic, entirely on one side of diagonal; 

• Class II: horizontal tangency, never reaches diagonal; 

• Class IV: horizontal plus diagonal tangency, no crossing; 

• Class III: no tangencies, curve crosses diagonal. 

For the one-dimensional case, all neighbourhoods are considered, as follows: 

pt+i= E %W(i-ft) n "* (i) 

3=0 

such that j indexes every neighbourhood, X are cells £i_ r , . . . , Xi, . . . , Xi +r , n 
is the number of cells in every neighbourhood, v indicates how often state '1' 
occurs in X, n — v shows how often state '0' occurs in the neighbourhood X, p t 
is the probability of a cell being in state '1', and qt is the probability of a cell 
being in state '0'; i.e., q = 1 — p. For Mean field theory in other lattices and 
dimensions, please consult [4T| 143] . 

1.2 Basins of attraction approximation 

Andrew Wuensche, together with Mike Lesser, published a landmark book enti- 
tled "The Global Dynamics of Cellular Automata" in 1992 (105] which contained 
a very extended analysis of attractors in ECA. Wolfram himself had explored 
part of these cycles in "Random Sequence Generation by Cellular Automata" 
[110] ■ as had Mcintosh in "One Dimensional Cellular Automata" [73]. Notably, 
Stuart Kauffman in his book "The Origins of Order: Self-Organization and Se- 
lection in Evolution" [50] applies basins of attraction to sample random Boolean 
networks (RBN) in order to illustrate his idea that RBN constitute a model of 
the gene regulatory network, and that cell types are attractors. The best de- 
scription of such an analysis is to be found in [117] . A basin (of attraction) field 
of a finite CA is the set of basins of attraction into which all possible states and 
trajectories will be organized by the local function tp. The topology of a single 
basin of attraction may be represented by a diagram, the state transition graph. 
Thus the set of graphs composing the field specifies the global behaviour of the 
system [105] . Generally a basin can also recognize C A with chaotic or complex 
behaviour using prior results on attractors |105j . Thus, Wuensche says that 
Wolfram's classes can be represented as a basin classification [105j . as follows: 

• Class I: very short transients, mainly point attractors (but possibly also 
periodic attractors), very high in-degree, very high leaf density (very or- 
dered dynamics); 

3 The do Bruijn diagrams have been culled from Masakazu Nasu's 1978 work on tessellation 
automata I83| . Wolfram himself has explored some of this in I109| , later thoroughly analysed 
by Mcintosh [68] [73], Sutner [95], Burton Voorhes [T02l[T03] . and, particularly, exploited to 
calculate reversible ID CA using de Bruijn diagrams derived from the Welch diagrams by 
Seck-Tuoh-Mora in [891I9T] 
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• Class II: very short transients, mainly short periodic attractors (but also 
point attractors), high in-degree, very high leaf density; 

• Class IV: moderate transients, moderate-length periodic attractors, mod- 
erate in-degree, very moderate leaf density (possibly complex dynamics); 

• Class III: very long transients, very long periodic attractors, low in-degree, 
low leaf density (chaotic dynamics). 

1.3 Compressibility approximation 

A compression-based classification of CA (and other systems) was proposed in 
|119j , based on the concept of algorithmic (Kolmogorov) complexity. Unlike the 
Mean field theory, this technique analyses the asymptotic statistical properties of 
CA by looking at full space-time evolution of individual rules up to an arbitrary 
number of steps. The method produces the following variation of Wolfram's 
classification [120] . 

• Class I: highly compressible evolutions for any number of steps; 

• Class II: highly compressible evolutions for any number of steps; 

• Class III: the lengths of compressed evolutions asymptotically converge to 
the uncompressed evolution lengths; 

• Class IV: the lengths of compressed evolutions asymptotically converge to 
the uncompressed evolution lengths. 

The four classes seem to give way to only two (Classes I and II and Classes 
III and IV are not distinguishable in this first approach). But it is shown how 
algorithmic information theory helps to separate them again, using the concept 
of asymptotic behaviour advanced in [1191 1121] . 

The motivation in [119] is to address one of the apparent problems of Wol- 
fram's original classification, that of rules behaving in different ways starting 
from different initial configurations. In the experiments that led Wolfram to 
propose his classification he started the systems with a "random" initial con- 
figuration as a way to sample the behaviour of a system and circumvent the 
problem of having to choose a particular initial configuration to map a system 
to its possible class of behaviour. The problem resides in the fact that a CA, like 
any other dynamical system, may have phase transitions, behaving very differ- 
ently for different initial configurations (the question is ultimately undecidable 
as pointed out in [26] ) but this is also a practical issue for an heuristic classifi- 
cation, given that systems may seem to jump from one class to another in such 
phase transitions. The chances of having a CA display an average behaviour 
(that is, its behaviour for most initial configurations) are greater when taking 
a "random" initial configuration, only if one assumes that there is no bias to- 
wards any particular region of the possible enumerations of initial configurations 
(consider the behaviour of a CA starting from one initial configuration versus 
another (see Figures [2| . In [119] this issue is addressed with the definition of 
a compression-based phase transition coefficient capturing the asymptotic be- 
haviour of a system, which in turn allows to separate the collapsed classes and 
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Figure 2: To which of Wolfram's Classes do these two ECAs (Rule 22 and Rule 
109) belong? (a) Wolfram's ECA Rule 22 starting from a single black cell, (b) 
Rule 22 starting from another initial configuration (11001), (c) Wolfram's ECA 
Rule 109 starting from a single black cell, (d) The same Rule 109 starting from 
another initial configuration (111101). 
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even advance a different and alternative classification, based on the sensitivity 
of a CA to its initial conditions, which has also been conjectured to be related 
to the system's ability to transfer information, and ultimately to its computing 
abilities, particularly as these relate to Turing universal computation (see |121j V 
This approach does not solve the problem of a system that behaves in a qualita- 
tively different manner after a certain number of initial input configurations or 
after a certain period of time (the same problem encountered when devising the 
original classification) , which is not a problem of method, but is instead related 
to the general problem of induction and of reachability (hence to undecidability 
in general). Nonetheless it does address the problem of a reasonable definition 
of the "average behaviour" of a system (in this case a CA) under the same 
assumptions made for other enumerations (viz. that enumerations, especially 
natural ones, have no distinct regions where a system starts behaving in a com- 
pletely different fashion, making it impossible to talk about the convergence in 
behaviour of a system). Wolfram's classes can once again be separated using 
the compression-based approach in combination with the following classification 
[120J, derived from a phase transition coefficient presented in |119j : 

• Class I: insensitivity to initial configurations, inability to transfer infor- 
mation other than isolated bits; 

• Class II: sensitivity to initial conditions, ability to transfer some informa- 
tion; 

• Class III: insensitivity to initial configurations, inability to transfer infor- 
mation, perhaps due to lack of (evident means of) control; 

• Class IV: sensitivity to initial conditions, ability to transfer some informa- 
tion. 

One can only understand how Classes I and III can now be together in 
this classification on the basis of the qualitative treatment explained above. In 
other words, when one changes the initial configuration of a system in either 
of these two classes (I and III) the system's behaviour remains the same (each 
evolution is equally compressible), and it is therefore considered unable to or 
inefficient at transferring information or programming a CA to perform (uni- 
versal) computation. On the other hand, this suggests that classes II and IV 
may be better at transferring information, even if they may do so in different 
ways. This classification may tell us that some classes are more sensitive to 
initial configurations. 

Together, the compression-based classifications capturing different behaviours 
of the systems capture other intuitive notions that one would expect from Wol- 
fram's original classification. The values for ECA calculated in |119j yielded 
results that also suggest that one may be able to relate these measures to uni- 
versality through the definition of Class IV, as given above (see |I21| ). 
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2 Universal CA Class IV versus Class III 



Karel Culik II and Sheng Yu have demonstrated that whether a CA be- 
longs to Class IV is undecidable. Nevertheless, some approximations have been 
developed, with interesting results. The use of genetic programming by Melanie 
Mitchell, Rajarshi Das, Peter Hraber, and James Crutchfield [751 EEj *° obtain 
sets of rules with particles and computations is a case in point. As indeed is 
Emmanuel Sapin's calculation of a non-additive binary universal 2D CA with 
a genetic algorithm, the R rule [S7JIHE]- However, the use of evolutionary tech- 
niques has been limited to a small portion of complex CA with few states and 
small configurations. Up to now, brute force programming has been necessary 
to obtain monsters of complex patterns in huge spaces, as Eppstein shows in 

EH- 

2.1 The Game of Life: Class IV 

The most popular 2D CA is certainly Conway's Game of Life (GoL), a binary 2D 
additive CA, first published in Martin Garden's column in Scientific American 
[34] . GoL can be represented as i?(2,3,3,3), or typically, as the -B3/S23 rulej^] 
In 1982, Conway proved that GoL was universal by developing a register machine 
working with gliders, glider guns, still life and oscillator collisions Q~7J. However, 
such universality was completed by Paul Rendell's demonstration in 2000 that 
involved implementing a 3-state, 3-symbol Turing machine in GoL [851 186] - The 
machine duplicates a pattern of l's within two l's on the tape to the right of the 
reading position, running 16 cycles to stop with four l's on the tape. A snapshot 
of this implementation is provided in Fig. [3^,. For details about each part and 
about the functionality of this machine please visit "Details of a Turing Machine 
in Conway's Game of Life" http://rendell-attic.org/gol/tmdetails.litm. 

GoL is a typical Class IV CA evolving with complex global and local be- 
haviour. In its evolution space we can see a number of complex patterns which 
emerge from different configurations. GoL has been studied since 1969 by Con- 
way, and William Gosper of MIT's Artificial Life research group has taken a 
strong interest in it. The tradition of GoL research is very much alive, with 
today's GoL researchers discovering new and very complex constructions by 
running complicated algorithms. Just last year, GoL celebrated its 40th an- 
niversary. The occasion was marked by the publication of the volume "Game 
of Life Cellular Automata" [5], summarising a number of contemporary and 
historical results in GoL research as well as work on other interesting Life-like 
rules. 

According to Mean field theory, p is the probability of a cell's being in state 
'1' while q is its probability of its being in state '0' i.e., q = 1 — p, and the mean 
field equation represents the neighbourhood that meets the requirement for a 
live cell in the next generation [57]. As we have already seen, horizontal plus 

4 An excellent forum on GoL is "LifeWiki" http://conwaylife.com/wiki/index.php? 
title=Main_Page To complement this, you may consult "The Game of Life Sites" http: 
//uncomp .uwe . ac .uk/genaro/Cellular_Automata_Repository/Lif e .html 
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Figure 3: (a) A 3-state, 3-symbol Turing machine in GoL by Rendell [551 155] . 
(b) its mean field curve. 
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diagonal tangency, not crossing the identity axis (diagonal), and the marginal 
stability of the fixed point (s) due to their multiplicity indicates Wolfram's Class 
IV [42j . or complex behaviour. Hence, we will review the global behaviour of 
GoL using Mean field theory. Figure ^jp shows the mean field curve for GoL, 
with polynomial: 

p t+1 =28p 3 t q 5 t {2pt + 3qt)- 

The origin is a stable fixed point, while the unstable fixed point p = 0.2 
represents the fact that densities around 20% induce complex behaviour for 
configurations in such a distribution, p — 0.37 is the maximum stable fixed 
point where GoL commonly reaches global stability inside the evolution space. 

In |122j a compression-based phase transition coefficient was calculated, 
showing that, as expected, GoL exhibits a high degree of variability and po- 
tential (efficient) programmability. This is in agreement with the known fact 
that GoL is capable of universal computation, and hence supports the idea that 
sensitivity to initial configurations is deeply connected to both programmability 
and (Turing) universality. 
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Figure 4: Mean field curve for EC A Rule 110. 



2.2 Life-like rule B35/S236: Class III 

The Life-like CA evolution rule 7335/5*236 was proposed by Eppstein and Dean 
Hickerson as a chaotic CA with sufficient elements for developing universality. 
Details about these computable elements are available at http : //www, ics .uci"7| 
edu/~eppstein/ca/b35s236/construct .html. The family of gliders and other 
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(a) 




complex constructions in this rule can be found at http://www.ics.uci.edu/ 



-eppstein/ ca/b35s236/ . 

The 535/5236 automaton commonly evolves chaotically. Figure [5]a, displays 
a typical chaotic evolution starting from an L-pentomino configuration; after 
1,497 generations there is a population of 52,619 live cells. Here we see how a few 
gliders emerge from chaos and then quickly escape, although the predominant 
evolution over a long period is chaotic. 

Figure [5]d shows the mean field curve for CA 535/5236, with polynomial: 

Pt+i = 28p 3 tP 2 t (pt + 2p t ql + 2 V \q\ + 3qt). 

The origin is a stable fixed point (as in GoL) which guarantees the stable 
configuration in zero, while the unstable fixed point p = 0.1943 (again very sim- 
ilar to GoL) represents densities where we could find complex patterns emerging 
in 535/5236. p = 0.4537 is the maximum stable fixed point at which 535/5*236 
commonly reaches global stability. 

This way, 535/5236 preserves the diagonal tangency between a stable and 
an unstable fixed point on its mean field curve. But although its values are 
close to those of GoL, CA 535/5236 has a bigger population of live cells, which 
is not a sufficient condition for constructing reliable organisms from unreliable 
components. 



2.3 ECA Rule 110: Class IV 

The ID binary CA rule numbered 110 in Wolfram's system of classification |107j 
has been the object of special attention due to the structures or gliders which 
have been observed in instances of its evolution from random initial conditions. 
The rule is assigned number 110 in Wolfram's enumeration because it repre- 
sents the decimal base of the transition rule expanded in binary: 01110110. 
The transition function evaluates the neighbourhoods synchronously in order 
to calculate the new configuration transforming the neighbourhoods 001, 010, 
011, 101 and 011 into state 1 and the neighbourhoods 000, 100 and 111 into 
state 0. It has been suggested that Rule 110 belongs to the exceptional Class 
IV of automata whose chaotic aspects are mixed with regular patterns. But in 
this case the background where the chaotic behaviour occurs is textured rather 
than quiescent, a tacit assumption in the original classification]^] Rule 110 was 
granted its own appendix (Table 15) in |110j . It contains specimens of evolu- 
tion including a list of thirteen gliders compiled by Lind and also presents the 
conjecture that the rule could be universal. 

The literature on the origins of Rule 110 includes a statistical study done by 
Wentian Li and Mats Nordahl in 1992 [S3]. This paper studies the transitional 
role of Rule 110 and its relation to Class IV rules figuring between Wolfram's 
classes II and III. The study would seem to reflect an approach to equilibrium 
statistics via a power law rather than exponentially. Matthew Cook wrote an 

5 A repository of materials on ECA Rule 110 can be found at: http://uncomp.uwe.ac.uk/ 
genaro/Rule 110 .html 
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eight page introduction [21. listing gliders from A through H and a glider gunj^J 
This list shows new gliders which do not appear on Lind's list, gliders with rare 
extensions, and a pair of gliders of complicated construction, including an amaz- 
ing glider gun. Cook makes a comparison between Rule 110 and Life, finding 
some similarities in the behaviour of the two evolution rules and suggesting that 
Rule 110 may be called "LeftLife." 

Looking at the rule itself, one notices a ubiquitous background texture which 
Cook calls "ether," although it is just one of many regular stable lattices ca- 
pable of being formed by the evolution rule, and can be obtained quickly using 
the de Bruijn diagrams [70] HSU- Mcintosh raises the issue of the triangles of 
different sizes that cover the evolution space of Rule 110 [71]. The appearance 
of these triangles suggests the analysis of the plane generated by the evolution 
of Rule 110 as a two dimensional shift of finite type. This suggestion is arrived 
at by observing that the basic entities in the lattices, the unit cells, induce the 
formation of upside-down isosceles right triangles of varying sizes. The signif- 
icance of Rule 110 could lie in the fact that it is assembled from recognisably 
distinct tiles, and hence its evolution can be studied as a tiling problem, in the 
sense of Hao Wang [37] . It may even be possible to see fitting elements of one 
lattice into another as an instance of Emil L. Post's correspondence principle 
|27| , which would establish the computational complexity of the evolution rule 

The most important result both in the study of Rule 110 and in CA theory 
over the last twenty years, is the demonstration that Rule 110 is capable of 
universal computation [22l 1114] 172] [23] [65] . For so a type of system called a 
cyclic tag system (CTS) as a variation of a well-known model of computation 
(Post's tag systems) was designed to be of use for the proof and its charac- 
teristic restrictions: ID, boundary conditions, package of gliders, and multiple 
collisions. CTS are a new kind of computing formalism [32] 1114] used as tools 
for implementing computations in Rule 110. 

Fig.[4j) shows the mean field curve for Rule 110 with polynomial: 

Pt+i = 2Pt<£ + 3ptq t . 

The origin of Fig. [4] displays a stable fixed point (as in GoL) which guarantees 
the stable configuration in zero. The maximum point (p = 0.6311) is close to the 
fixed stable point in p — 0.62. In Rule 110 we cannot find unstable fixed points, 
and in any case the emergence of complex structures is ample and diverse. 

A basin (of attraction) field of a finite CA is the set of basins of attraction 
into which all possible states and trajectories will be organised by the local 
function ip. The topology of a single basin of attraction may be represented by 
a diagram, the state transition graph. Thus the set of graphs composing the 
field specifies the global behaviour of the system [105] . 

As calculated in [119], rules such as Rule 110 and Rule 54 (also believed 
to be capable of universal computation) had a large compression-based phase 

6 An extended list of gliders in Rule 110 is provided in http : //uncomp.uwe . ac .uk/genaro/ 
rulellO/glidersRulellO.html 
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transition coefficient, as discussed in Section [L3j meaning that their ability to 
transfer information was well captured by the measure defined in 119 (and, 
interestingly, perhaps strengthens the belief that Rule 54 is capable of Turing- 
universality) . 



3 Heat and programmability in Class III 

Class III CAs may turn out to be too sensitive, so the question may be whether 
even if they are that sensitive they can carry information from one side to an- 
other. Universality results in simple programs capable of complicated behaviour 
have traditionally relied on localised structures ("particles") well separated by 
relatively uniform regions. It could also be the case that proofs of universality of 
seemingly Class IV systems are easier to construct because of its "particle-like" 
behaviour, unlike systems seemingly in Class III. 

The open problem is thus to prove computational universality in a simple 
program system for which an entropy measure on each time step remains near 
its maximum - e.g. 80% of its maximum theoretical value on at least 80% of its 
time steps. Can a "hot system" of this sort perform meaningful computation? 

In the Game of Life, for example, there is a common intuitive notion of /iea^] 
defined as the average number of cells which change state in each generation 
(note the strong connection of Shannon's Entropy and the Mean Field Theory). 
For example, the heat of a glider in GoL is known to be four, because two cells 
are born and two die in every generation, and that for a blinker is 4, because 2 
cells are born and 2 die in every generation. In general, for a period n oscillator 
with an r-cell "rotor", the heat is at least 2r/n, and no more than r(l — (n 
mod 2)/n). 

The concept of heat can clearly be associated with Wolfram's chaotic Class 
III, where CAs, e.g., rule 30, change state at a very high rate, (see Figures 
(c) [l]) , which is what keeps them from developing persistent structures such as 
are seen in Rule 110 (see Figure (d) [I]). The presence of persistent structures 
in Wolfram's Rule 110 and Conway's Game of Life is what traditionally has 
been used to perform computation-implementing logic gates or transferring in- 
formation over time by putting particles in the way of interacting with each 
other. So the question is whether CAs such as the ones belonging to Wolfram's 
Class III are "too hot" to transfer information and are therefore, paradoxically 
in this particular way, just like Class I systems which are unable to perform 
computation. Alternatively, Class III may be able to perform computation, as 
has been suggested, but it may turn out to be difficult to program such systems 
(if not designed to "look" like a Class III system by using first a system from a 
Class IV, somehow hiding the computing capabilities of the Class III system), 
and this potential similarity between the insensitivity to initial conditions of 
Class I and Class III systems is what the compressibility approach discussed in 



Section 1.3 is measuring and which has been advanced in |120j as a measure 



of programmability. Wolfram identified some of these issues in his enumeration 



7 See http://www.argentum.freeserve.co.uk/life.htm accessed in July 2012. 
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of open problems in the research on CA [1 13] (problems 1, 2 and 14), concern- 
ing the connections between the computational and statistical characteristics 
of cellular automata, measures of entropy and complexity and how to improve 
his classification using dynamic systems (which was one of the motivations of 
|119j ). Wolfram asks, for example, about the rate of information transmission of 
a CA in relation to its Lyapunov exponent (positive for Classes III and IV) and 
the computational power of these systems according to their classes. Another 
interesting question concerns the connection to Langton's A parameter |51j and 
the ongoing investigation of its connections to some of the approaches described 
in this paper. In |15j a similar approach is taken using Lyapunov exponents 
and Jacobians- anticipated by Wolfram in |110j -where the calculation of the 
number of cells that differ provide a metric of the average rate of transmission 
of information (one that is related to the more informal term heat in GoL). 

4 Final remarks 

Usually, Class III rules are not considered candidates for computational uni- 
versality. However, in some cases such rules can support complex patterns, 
including performing complex computations. Exploring many CA rules, includ- 
ing the exceptionally chaotic Life-like rule Dead without Life [35] , one finds that 
there are several rules between chaos and complexity which are not included 
within the domain of complex behaviour. However, they present many elements 
equally likely to reach Turing computational universality. An important point 
made in this survey and review is that it seems clearly to be the case that it 
is not only complex Cj^\ rules that are capable of computation, and that CA, 
even if simple or random-looking, may support Turing universality. Whether 
the encoding to make them actually compute turns out to be more difficult 
than taking advantage of the common interacting persistent structures in rules 
usually believed to belong to Wolfram's class IV is an open question. 

Previous results on universal CAs (developing signals, self-reproductions, 
gliders, collisions, tiles, leaders, etc.) prove that unconventional computing can 
be obtained depending on the nature of each complex system. For example, 
to prove universality in Rule 110 it was necessary to develop a new equivalent 
Turing machine to take advantage of limitations in ID and the same dynam- 
ics in its evolution space, e.g., mobility of gliders and boundary properties. 
Hence, a CTS was devised, before this system was known as a circular ma- 
chine [TH H21 [721 [SS] . This way, the nature of each system would determine 
the best environment in which to design a corresponding computer. This could 
be the basis of Wolfram's Principle of Computational Equivalence and it is also 
the inspiration behind the definition of programmability measures for natural 
computation in |120j . Wolfram's Principle of Computational Equivalence ulti- 
mately only distinguishes between two kinds of behaviours (despite Wolfram's 

8 A Complex Cellular Automata Repository with several interesting rules is available at 
http://uncomp.uwe.ac.uk/genaro/otherRules.html We particularly recommend Tim Hut- 
ton's Rule Table Repository http : //code .google . com/p/ruletablerepository/ 
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own heuristic classification), namely those that are "sophisticated" enough and 
reach Wolfram's threshold, constituting a class of systems capable of computa- 
tional universality, and those that fall below this threshold and are incapable 
of universal computation. And indeed, the compression-based classification in 
|119j at first distinguishes only two classes. 

A number of approximations were developed or adapted to find complex CA. 
Perhaps the most successful technique was the one developed by Wuensche, with 
its Z parameter [118] . Some attempts were made by Mitchell et. al using ge- 
netic algorithms, although they had a particular interest in finding rules able to 
support complex patterns (gliders) with computational uses [351 1116] . Unfor- 
tunately, these algorithms have strong limitations when it comes to searching 
in large rule spaces and very complex structures. And though the technique in 
[1 19] has proven capable of identifying complex systems with great accuracy, it 
requires very large computational resources to extend the method to larger rule 
spaces if a thorough investigation is desired (though in conjunction with other 
techniques it may turn out to be feasible). 

As it has proven to be a very rich space, new kinds of CAs are proposed 
all the time, e.g., reversible CA (331101111], partitioned CA [TT2] . hyperbolic 
CA [58], CA with non- trivial collective behaviour (self-organization) [231 [25] . 
asynchronous C A [35] , biodiversity in CA [55] , C A with memory [H [TU] , mor- 
phological diversity [12] , identification of CA [2], communication complexity 
[221125], pattern recognition from CA [T3], to mention a few. 

Some other studies dedicated to designing or identifying universal CAs are 
[44, 3, 4, 36, 62 . Obtaining CA of Class IV from other rules has been studied via 
lattice analysis [39], with memory [56l EH E21 [3 HH [8] , asynchronous [97 ] IT00 l [T8l 
152] . differential equations [15], partitioned [TUTHHHHnHHOllZZllSnilSI], parity- 
filter CA [531 H31 13Z] ; number-conserving [5T] changing different neighbourhoods 
inCAQ]!]. 

CA as super computer models are developed extensively in [1041 l20l [TBI 1551 

[821 EH EU E21 EH [Ml E31 El H m [mil Eg [66]. 
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